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Our interest is in the cumulative probabilities Pr(L(i) < I) for the maximum length of 
increasing subsequences in Poissonized ensembles of random permutations, random fixed 
point free involutions and reversed random fixed point free involutions. It is shown that 
these probabilities are equal to the hard edge gap probability for matrix ensembles with 
unitary, orthogonal and symplectic symmetry respectively. The gap probabilities can be 
written as a sum over correlations for certain determinantal point processes. From these 
expressions a proof can be given that the limiting form of Pr(L(f) < I) in the three cases 
is equal to the soft edge gap probability for matrix ensembles with unitary, orthogonal and 
symplectic symmetry respectively, thereby reclaiming theorems due to Baik-Deift- Johansson 
and Baik-Rains. 



1 Introduction 

Let Sn denote the set of all permutations of {1,2,..., N}. Let tt G Sn and consider a subsequence of 
image points nfo), ■ ■ ■ , 7r(ifc)} where 1 < ix < ■ ■ ■ < ik < N. Such a subsequence is referred to as 

an increasing subsequence of length k if 7r(ii) < n(i2) < ••• < 7r(ifc). For a given n, let Ln(tt) denote the 
maximum length of all the increasing subsequences. The question of the distribution of Ln(tt) ='■ Ln, 
when 7r is chosen at random from a uniform distribution on Sn, was posed in the early 1960's by Ulam. 
In 1999 the question was answered by Baik, Deift and Johansson ||, who proved 

where ^(s) is the scaled cumulative distribution of the largest eigenvalues for large random Hermitian 
matrices with complex Gaussian entries (technically matrices from the Gaussian unitary ensemble (GUE)) 
[]35[ . One should consult for a review of the work on Ulam's problem culminating in the Baik-Dcift- 
Johansson theorem. 

In the course of proving ([j~l|), the exponential generating function of Pr(Ljv < I), 

co N 
N=0 

was introduced. This quantity itself is the cumulative distribution of a natural quantity due to Hammer- 
sley (see e.g. Q). Thus consider the unit square with points chosen at random according to a Poisson 
process of rate t. Form a continuous piecewise linear path, with positive slope where defined, connecting 
(0,0) to (1,1) and only changing slope at a point. Let L a (t) denote the length of the longest such 
"up/right" path, where the length is defined as the number of Poisson points in the path. To see the 
relation to (fL~2]), label the points 1, . . . , JV from left to right, then attach a second label 1, . . . , JV from 
bottom to top. In this way each array of N points is associated with a permutation, and furthermore 
the fact that the points are chosen from a Poisson process implies the uniform disitribution on the set of 



permutations of N symbols. Up/right paths correspond to increasing subsequences and we have 

Pr(L D (i)<0 = e-*A(t). (1-3) 



It was proved in [pi that 
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In fact (1.4) suffices to prove (fbl]), by applying a so called de-Poissonization lemma Jl9| . 

Four companion identities to ( |l.4[ ), relating the limiting distribution of longest paths in certain 
up/right paths problems to the limiting distribution of the largest eigenvalue in certain random ma- 
trix ensembles, were found by Baik and Rains ^, |5|. Of these two are independent, in that it was shown 
that the other two follow as corollaries ||, Theorem 2.5]. For the first, modify the original longest up/right 
path problem by requiring that initially only the region below the line y = 1 — x of the unit square be 
filled with Poisson points of rate t; the points above the line are then specified by the image of the initial 
points reflected about y = 1 — x. Let L N (t) refer to the longest up/right path from (0, 0) to (1, 1) in this 
setting. Then one has 

}^M ^M^ <s)=F 1 (s), (1.5) 



where i*i(s) is the cumulative distribution of the largest eigenvalue for large random real symmetric 
matrices with Gaussian entries (technically matrices from the Gaussian orthogonal ensemble (GOE)) 
$7\ . The random variable L m (t) is related to the maximum length Lf N of all decreasing subsequences of 
random fixed point free involutions (ji 2 — it, n(i) ^ i) for any i) of {1, 2, . . . , 27V}, or equivalently of all 
increasing subsequences of reversed fixed point free involutions. Thus 

Pr(L s (t) < Z) = e-*/*D?(t), Df{t) := £ * Fr ^ ~^ . (1.6) 

For the second of the companion identities, the original longest up/right path problem is modified 
by requiring that initially only the region below the line y = x of the unit square be filled with Poisson 
points at rate t, with the points above the diagonal specified as the image of these points reflected about 
y = x. With L a (t) referring to the longest up/right path in this setting, one has 



lim Pri 



where F&(s) is the scaled cumulative distribution of the largest eigenvalue for large random Hermitian 
matrices with real quaternion elements (technically matrices from the Gaussian symplectic ensemble 
(GSE)). With L^ N denoting the maximum length of increasing subsequences of random fixed point free 
involutions of {1, 2, ... , 27V}, one has 

Pr(L (t) < = e-^Df{t), D?(t) := £ ^^"f ° - (1-8) 



In this paper we will give new proofs of the results ( |l.4| ), ( [j~5| ) and ( |l.7j ). The original proof of (1.4) 



uses a Riemann-Hilbert analysis § . The subsequent proofs of ( |l.4| ) given in [^l[ 0] rely on proving the 
convergence of a certain Fredholm integral operator determing Pr(L D (i) < I) to the Fredholm integral 
operator determining Fzfe). A combinatorial proof exploiting the interplay between maps and ramified 



coverings of the sphere is given in |27|| . In the cases of ( |l.5| ) and (1.7), a Riemann-Hilbert analysis was 
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again used in the original proof j^]. No other derivations of (1.5) and (1.7) have previously been given. 
Our derivation relies on finding expressions for Pr(L D (i) < I), Pr(L s (i) < I), Pr(i (t) < I) as sums 
over correlations determining the probability of the interval (0, t) being eigenvalue free in the infinite, 
scaled Laguerre unitary ensemble (LUE), Laguerre orthogonal ensemble (LOE), and Laguerre symplectic 
ensemble (LSE) with parameter value a — I. The latter are known as hard edge gap probabilities. The 
probabilities F 2 (s), Fi(s) and F^s), give the so called soft edge gap probability that the interval (s, oo) 
is eigenvalue free in the infinite scaled GUE, GOE and GSE respectively, and can also be written as 
a sum over correlations. The limit formulas ( jl.4| ), (1.5) and (1.7) are then proved by establishing the 
convergence as a — > oo of the sum over correlations determining the hard edge gap probabilites, to the 
sum over correlations determining the soft edge gap probabilities. Related studies of the convergence of 
the finite N soft edge gap probability in the LOE and LUE to the corresponding scaled soft edge gap 

|22] , [33|| , and it is the method of 1 33 which we adopt 



probability has previously been undertaken in |2fj|, | 
here. 

In Section 2 we present formulas from the theory of zonal polynomials which allow Pr(L n (i) < I), 
Pr(L s (t) < I) and PrL (i) < I) to be expressed as hard edge gap probabilities. In Section 3 we show 
how the hard edge gap probabilities can be written as sums over correlations for certain determinantal 
point processes, and this exercise is repeated for the soft edge gap probabilities F\(s), i'b(s) and Fi(s). 
The convergence of the sum over correlations determining the hard edge gap probabilities, to the sum 
over correlations determining the soft edge gap probabilities, is established in Section 4. 



2 Averages over classical groups and the hard edge gap proba- 
bility in the Laguerre ensemble 

that the generating functions of interest each can be written as averages 



It has been shown by Rains 
over classical groups. Thus 



Dfit) 



/ v / tTr(t/+[/ t )\ 

\ e y ')ueu(i) 

\ e )S£Sp(l) 

\e )oeO(2i) 



(2.1) 
(2.2) 
(2.3) 



(we use the notation Sp(l) to denote I x / unitary matrices with real quaternions elements, or equivalently 
21 x 21 symplectic unitary matrices with complex elements). 

The average (2.1) earlier appeared as the cumulative distribution of the smallest eigenvalue for the 
scaled LUE [jiol . We recall the LUE refers to the eigenvalue probability density function 



1 N 

1=1 



JJ (A fe - Aj) 2 , A* > 0. 

l<j<k<N 



(2.4) 



For a 



— N, n > N, it is realized by eigenvalues of the matrix X^X, where X is a n x N complex 
Gaussian matrix. The cumulative distribution of the smallest eigenvalue for the ensemble (2.4) (or what 
is the same thing, the probability of no eigenvalues in the interval (0, s)), to be denoted E^s; a; N), is 



obtained from (2.4) by integrating each of the eigenvalues over (s, 00), 

-1 />oo />oo 

E% {s;a;N):=- J dXi A?e~ Al ■ J d\ N X a N e 



n ( a * 

l<j<k<N 



(2.5) 
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(the normalization C is such that E% (0; a; N) = 1). Rescaling the eigenvalues in the vicinity of the origin 
(referred to as the hard edge since the eigenvalues are restricted to A/ > 0) by 

A, - (2.6) 

the correlations have a well defined N — > oo limit ||Tl"|| . This implies the scaled gap probability 

E^(s;a):=l^Ef(^;a-,N) (2.7) 

exists. Moreover, it was shown in Q that for a G Z> , -Ef(s;a;Af) has a simple structure, allowing 
it, and its scaled limit, to be expressed as an a x a determinant. The determinant can alternatively be 
written as an a-dimensional integral, giving [jTo[ 

E 2 [s;a) — e (e^ v ')ueu(a), (2-») 

and thus relating to ( |2.lD . 

The averages ( |2.2| ) and ( [2.3| ) have recently been shown to be equal to the cumulative distribution of 
the smallest eigenvalue in the scaled, infinite LOE and LSE respectively |17 . These matrix ensembles 
refer to the eigenvalue probability density function 

1 N 

ci[ x ? e ~ cXi/2 n l^- A /> A <>°> ( 2 -9) 

1=1 l<j<k<N 

where (3 = 1, c = 1 for the LOE, and /3 = 4, c = 2 for the LSE. For a = (n - N - l)/2, n > iV, the LOE 
is realized by random matrices of the form X T X, where X is a n x N real standard Gaussian matrix, 
while for a — 2(n — N) + 1, matrices of the form X^X with XanxJV real quaternion Gaussian matrix 
(embedded as a complex matrix) realizes the LSE (see e.g. |l|]). For general parameters a,c,[3 in (2.9), 
analogous to (2.5) we define the gap probability 

E%(s;a,c;N):=- dX, \\e' c ^l 2 ■ ■ ■ \ d\ N \ a N e~ cX " ' 2 [] \Xk~Xjf- (2.10) 

^ s l<j<k<N 

As an aside we remark that a random matrix construction of the general [3 Laguerre ensemble has recently 
been given Q . For the scaled limits of the LOE and LSE cases one defines 

E^[s;a) := a, 1; iv) (2.11) 

E^ d (s;a) := Jim^(^;a,2;iV/2) (2.12) 

(in ( 2.12| ) it is assumed N is even; the use of N/2 therein comes about naturally in studying the inter- 
relationships between E\ , E^ and E\ Jll|). We know from 17 that 

E{^\s-d) = e- s / 8 (e^s )sesp{a) (213) 
£ 4 ihard ( S ;2a) = (e^ Tr0 ) 0e0(2a) . (2.14) 



The derivation of (2J3) in |10| is different from the derivations of ( 2.13 ) and ( 2.14 ) in ||17j. A unifying 
derivation can be given, based on properties of zonal polynomials and corresponding hypergeometric 
functions, which we will now present. 

The zonal polynomials are the special cases a = 1/2,1 and 2 of more general polynomials — the 
Jack polynomials — which depends on a continuous parameter a. Let us then revise the definition of 
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these polynomials. Let k := (ki, . . . , kn) denote a partition so that Ki > Kj (i < j) and € Z>o- The 
modulus of a partition is defined by |k| := ^ZiLi Let m K denote the monomial symmetric function 
corresponding to the partition k, and for partitions \k\ = \fj,\ define the dominance partial ordering by 
the statement that k > [i if k ^ jj, and X)j=i K j — S?=i Mi f° r eacn P = 1, . . . , AT. Introduce the Jack 
polynomials P« (zi, . . . , Zn) ='■ Pk {%) as the unique homogeneous polynomials of degree \k\ with 
the structure 

P£ ,a \z)=m K + Yj a ^ m P 
(the a Kfl are some coefficients in Q(a)) and which satisfy the orthogonality 

where 



/■1/2 rl/2 

(f,g) (a) ■= / dx\--- I dx N f(z 1 ,...,z N )g(z 1 ,...,z N ) TT |^ fc - ^-p 

J-l/3 J-l/2 l<j<k<AT 



We remark that when a = I the Jack polynomials coincides with the Schur polynomials; also we should 
point out that there are other ways to define the Jack polynomials (see e.g. |^5f). Let 

<= II (a(a{i,j) + l) + l(i,j)), (2.15) 
(i,j)e« 

where the notation € ft refers to the diagram of ft, in which each part becomes the nodes 
1 < J < K i on a square lattice labelled as is conventional for a matrix. The quantity a(i,j) is the so 
called arm length (the number of nodes in row i to the right of column j), while is the leg length 

(number of nodes in column j below row i). Define the renormalized Jack polynomial 

^W:=^P« o) (4 (2-16) 
and introduce the generalized factorial function 

N 



u 



(a) = TT r(u- (j - Vj/a + Kj) 

K U T(u-(j-l)/a) • 



Then the generalized hypergeometric function p Fq based on the Jack polynomial (2.16) is specified by 
the series 

p F<«> (ax, .... op; 6x, .... 6,; *) := £ 1^ ' ' ' "t) ^ W (2-"0 

(when 2V = 1 this reduces to the classical definition of p F q ). For future reference, we draw attention to 
the confluence property 

km 2 F[ a) {N + a u N + a 2 ;b-z/N 2 )^ Q F[ a \b;z) (2.18) 

iV— >oo 

which is derived by recalling the homogeniety property ci a \z / N 2 ) = N~ 2 \ K \ci a \z) and taking the limit 
term-by-term (the latter is justified since 2 F[ a) is analytic for \z-\ < 1, i = 1, . . . , N ||). 

In the special cases a = 1/2, 1 and 2 the renormalized Jack polynomials C« (z) are zonal polynomials 
for symmetric matrices, complex matrices and real quaternion matrices respectively (see e.g. |25|| ). With 
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X such a matrix one defines Ck(X) = (7« (Ai, . . . , An) where Ai, . . . , An are the eigenvalues of X (the 
eigenvalues of a Hermitian matrix with real quaternion elements are doubly degenerate — in this case 
only the distinct eigenvalues are included). The zonal polynomials have a number of special properties 
not shared by the Jack polynomials in general. In particular, one has m m in 



(sx{AO)) 0e0 (n) 
(s x (AU)s K (tfAi)) UeU(n) 

(s\(AS)) S £ S p(n) 



Ck (AA t ) 

d 2) (i«) : 

o, 



2k = A 
otherwise 



= <S 



A, K ' 



d 1/2 \AAi) 

C7 (l/2) (1 „ ) ■ 



(2.19) 
(2.20) 
(2.21) 



0, 



otherwise 



where in ( 2.1 9| ) the partition 2k is the partition obtained by doubling each part of k, while in (2.21), k 2 
is the partition obtained by repeating each part of k twice. Also (l n ) := Cjt {z\, ■ ■ ■ , z n )\ Zl= ... =Zn= i. 
As an aside we note that these zonal polynomial identities have recently been conjectured to carry over 
to the more general g-setting J3lj . 

Of interest to us is a corollary of ( |2.19 )-( 2.2l| ). 

Corollary 1. We have 



= F^(n;AA^) 

Q F[ 2 \n/2 ] AA T /A). 



/.Tr(AO)\ 
(e ')OGO(n) 



Proof. Now we know that for general a |34| 

^ Q) (1") = M! 



v 2 l«l 



n/a 



(a) 



h K d' 



(2.22) 
(2.23) 
(2.24) 



(2.25) 



where d' K is specified by (2.15) and 



hn := II ( aa (*'i) + Khi) 
(i,j)eK 



We also know that (see e.g. p5|) 



Y- 



d\\a=l 



exp Tr X. 



(2.26) 



Consider the identities ( 2.19| ) and ( [2.21 ). We multiply both sides by l/d\\ a= i and use (2.26) on the left 



hand sides. On the right hand sides we use (2.25) and the easily verified identities 



(h K d' K )\ a= 

d2n\a=l 



= 1, 



2 2 \ K \{h K d' K )\ a=1/2 



= 1 



(2.27) 



together with the definition (|2.17|) to deduce (|2.23|) and (|2.24|) . The identity ( |2.22j) results by first 
multiplying both sides of fl2.2CP by l/(dA|Q=i) 2 , making use of ( |2.25D (note that for a = 1, e^. = h K ), 
then using J2.26| ) and (|t|). □ 
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We remark that the first two identities of Corollary [j] are due to James [[[s) , while the third, which is 
implicit in the work of Rains [^9|, appears not to have appeared in print before. 

The probability Ep(s; a, c; N) as specified by ([2.10 ), for general (3 > 0, general N, scale chosen with 
c — [3 and a G Z>o has been given in |l0| ] in terms of the generalized hypergeometric function 1 F[^^ 2 \ 
In the scaled N — > oo limit this same probability was given in terms of the generalized hypergeometric 



function F^^ 2 \ Thus one has 



££ hard (s;a,/3) := Km E 



-(^; a , / 3;iv)=e-^ Fr 2) (|;-i,...^ Q ) 



xi—---—x a —s/ 4 



(2.28) 



For P = 1 and (3 = 2 the definition of E% hard (s; a, /?) coincides with the definition of £f hard (s;a) given 



by ( [2.11 ) and E^ hard (s;a) given by (2.7) respectively, so we have 

£f w (s;a) = e- s / 8 ^ 1 (1/2) (2a; a;i ,...,x a ) 



s /4 



a;i — ■ ■■—x a =s/A 



(2.29) 
(2.30) 



However, in the case /3 = 4 the choice c = (3 used to derive (2.28) doesn't agree with the convention used 
to specify _E|' hard (s; a) in (2.12), which also had the pecularity of first having N replaced by N/2 before 



the N —>■ oo limit is taken. As a result, we have 



E 



L hard 



(s;a) = E i 



L hard / / a \ 

p (s/4;a,c) 



P=c=i 



and consequently 



E 



L hard 



{s;a)=e- s / s F$ 2 \a/2;x 1 ,...,x a ) 



s/16 



(2.31) 



(2.32) 



The identities @, ([H|) and ( |2~1^ ) can now be reclaimed. Thus in Corollary [l] we choose A — 
(Vi/2)I n , I n denoting the n x n identity matrix, and substitute the resulting forms in (|2.30|) , ( [2.2S| ) and 
( |2.32| ) respectively. 

With this side issue resolved, let us now explicitly state the implication of the identities ( |2.8| ), ( |2.13 ) 



and ( |2.14D in relation to the probabilities Pr(L D (t) < I), Pr(L s (f) < /) and Pr(L (£) < I). 
Proposition 1. We have 



Pr(L D (£/4) < I) 



E. 



L hard 



(i;0 



Pr(L N (t/4)<0 = £f hard (i;Z) 



Pr(L (i/4) < = E. 



L hard 



(*; 20- 



Proof. Substitute (2.8), ( 2.13 ) and ( 2.14 ) in the identities (|2.l|) -([2.3|) respectively, and then substitute 



the new from of (2.1)— (2.3) in (1.3), (1.5) and (1.6) respectively. 



□ 



3 The gap probabilities as a sum over /c-point correlations 

We seek formulas for the hard edge gap probability in Proposition [j] which enable the scaled i, I — ► oo 
limit to be analyzed. For this purpose we make use of the well known (and simple to derive) fact that 
for a general eigenvalue probability density function the probability (J) of having no eigenvalues in 
an interval I is given as a sum over the corresponding /c-point correlations, 

E( N \I) = 1 + J2^- fd Xl ---f dx k pi N \ Xl ,... : x k ). (3.1) 

k=l ' ^ 7 
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Let An(x) = on + a^x define a linear scale such that for x%, . . . ,x k fixed 

lim a k N p k N \A N (x{) 1 . . . ,A N (x k )) = p k {x x , . . . ,x k ) (3.2) 



where p k denotes the limiting distribution. We would like to be able to write lim^v^oo E^ N ' (An(I)) as 
the right hand side of ( |3.1| ) with p^ replaced by p k . Sufficient conditions for this to hold are given by 
the following specialization of a recent lemma due to Soshnikov [ |33"| . 

Proposition 2. Consider a sequence of point processes labelled by N . Suppose that after the linear scaling 
xj i > Ajq(xj) of each of the coordinates, the sequence approaches a limit point process with correlations 
{pk}k=i,2,... such ^at 



OO -if 

fe=l J 1 



-1/fc 

dxi ■ ■ ■ / dx k Pk(xi, ■ ■ ■ ,x k ) ) (3.3) 



diverges, and suppose furthermore that 

lim a% dx-i--- dx k Pk(A N (xi),...,A N (x k ))= / dx x ■ ■ ■ I dx k p k (xi, . . . , x k ). (3.4) 



N— >oo 

Then 



E(I):= lim £W(A ff (J)) = l + f]^ / dx x ■ ■ ■ [ dx k p k (x u . . . , x k ). (3.5) 

W^oo J fc! Jj Jj 

The significance of the condition that (3J5) diverges is that it implies [32| the limit process to 
then have the property that for any J Cl the distribution of the number of particles in / is uniquely 
determined by the correlation functions of the process. Observe that a sufficient condition for (3.3) to 
diverge is that 

J ' dxi- - ■ J dx k p k {xi, ...,x k ) = o(k\), (3.6) 



which itself is required for the series in (3.5) to be convergent. If we assume ( |3.6[ ), then ( |3.5| ) follows from 
( |3.4| ) by dominated convergence. 

Let us now compute the explicit form of (3J5) in the case of the LUE hard edge gap probability. The 
form of /Oj. in this case has a structure common to all probability density functions of the form 

1 N 

^n^M n i^-^f. (3.7) 

1=1 l<j<k<N 

Thus with W2{x) in ([Tt]) non- negative but otherwise general the corresponding fc-point correlations are 
given by 

p[ (xi, ...,x k ) = det[K(x J ,xi)] :j .i =lt ... tk , (3.8) 

where 

K , s , = (w 2 (x)w 2 (y)) 1/2 p N (x)pN-i(y) - Pn{v)pn-i(x) - 3 g . 

(p N -i,PN-ih x-y 

In J3.9| ) {pj{x)}j=os,... is the set of monic polynomials orthogonal with respect to ui2{x), and {p n ,Pn)2 
is the corresponding normalization. The LUE is the special case W2{x) — x a e~ x (x > 0) of ( |3.7| ). Denote 



( p.9[ ) in this case by K . Then we know 11 that for fixed x, y > 



lim —K L ( —,—) = K? cssc \ x,y), (3.10) 
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K 



\x,y) :- 



(3.11) 



2(x-y) 

Furthermore, it has been proved [|| that the convergence in ( 3.1C| ) is uniform for x, y in compact sets 
on the positive half line. Because / = [0, s] is compact, it follows immediately that (3.4) holds with 
o-n = 1/4-/V. The fact that p k is given by the determinant of a k x k symmetric non- negative matrix, the 
entries of which are independent of k, implies the bound ]2jJ 



Pk(xi 



This in turn implies 



l dXl -l 



,x k ) < Pi(xi) ■ ■■ pi(x k ). 



dx k p k (xi, ...,Xk) = 0(c k ) 



(3.12) 



for some c > 0, so (3.6) holds. Consequently, from Proposition | 
written in the following well known form [p6| . 



the scaled gap probability (2.7) can be 



Proposition 3. Let Kf essel be given by ( gjjp . 

Lhard/ . „\ 1 , I L ) 



We ho 



E. 



d M = l +H- 1 J- / <*»*••■/ 

fe=l ' J ° J ° 



dx k d&[Kf-»*{x h x l )] j ,i =1 ,..., k . 



(3.13) 



In the cases (3 = 1 and = 4 the limiting correlations are quaternion determinants, or equivalently 
Pfaffians Jl5], This leads to a more complicated analysis than that required for the case (3 = 2. 
However, at the expense of a minor digression, the computation of £;.p hard as a sum over correlations can 
also be posed as a problem involving (scalar) determinants rather than Pfaffians. In addition, by following 
this route we will reclaim the known fact jl6| that E^ hmd (s;a) is simply related to £ r | /llard (s; da) and 
Ei hard (s; ai) for particular ai,a 2 , so no independent analysis of E^ haid (s;a) is required. 

We begin our digression by revising that the general (3 Laguerre ensemble as specified by ( [2.9| ) can be 
viewed as a limiting case of the Jacobi ensemble, the latter specified by the eigenvalue probability density 
function 

N 



I[]A?(1-A ( ) b J] l A * 

l<j<k<N 



A, I 



< A, < 1. 



(3.14) 



For (3 = 1, 2 and 4, and a = (3(ni — m + l)/2 — 1, b = (3(ni — m + l)/2 — 1, this is realized by matrices 
of the form A(A + B)^ 1 , where A = a^a, B = b'b, with a, b real (/3 = 1), complex ((3 = 2) and real 
quaternion (/3 = 4) Gaussian random matrices of dimension Hi x m, % x m §|,[n|. To obtain (|j|) from 
( |3.14 ), make the replacement A; i— > c\\j2b in ( 3.14 ) and take the limit b — > oo. In the vicinity of A = 
both (^ and ( |3.14j ) have the same functional form, and so it is to be anticipated that after appropriate 
scaling the local statistical properties will also be the same. In the case of the hard edge gap probability, 
this can readily be demonstrated, as we will now show. 

Let Ep(s; a,b; N) denote the probability that there are no eigenvalues in the interval (0, s) of the 
Jacobi ensemble ( 3.14 ). Then by definition 

i /■! 

E^(s;a,b;N) 



1 

C 



dXi A;(l-Ai)* 



dX N Ajv(1 — Ajv)' 



n 

l<j<k<N 



1 



(1 _ s) (l+a+b)N+pN(N-l)/2 / + _ s)) a (1 _ Ai) b 



( d\ N {X N + s /{l-s)) a {l-\ N ) b \{ |A fe 

J 1 ^- ■ ^ I, A T 



A/. 



l<j<k<N 



(3.15) 
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Notice that for positive integer values of a the multidimensional integral in this last expression is a 
polynomial in s/(l — s). From the work of Kaneko | p3| we know that this multidimensional integral can 
be written as an a-dimensional generalized hypergeometric function > thus giving 



E J Js;a,b;N) = (1 - 8 )<i+*+b)rr+m*r-W 



x 2 F 



f /2 \-N;ha + b+l) + N~l,^a; Sl ,..., Sa } 



si—--- — s a — — s/(l — s) 



(3.16) 



(the normalization is fixed by requiring that both sides equal unity for s = 0). The scaled N — » oo limit 



can now be read off using (2.1 i 
Proposition 4. For a £ Z>o, 



2 a 
J 



si — — s a — s/4 



Comparing with ( 2.28| ) we see that 



E 



J hard 



(s;a) = E^ d ( S ;a,[3) 



(3.17) 



(3.18) 



as anticipated. Thus, we can drop the superscripts J and L and simply write £7g (s; a), where it is to 



be understood that in the case f3 = 4 we refer to the scaling ( 2.12| ) . 

There is an advantage in working with the Jacobi ensemble rather than the Laguerre ensemble. This 
comes about because of special features of the case b = of the former. One such special feature is the 
formula fllql 



E(< 



El (s;a,0; N) 



'(s/2; a + 1, 0; N/2) = - (eHs; (a - l)/2, 0; N) + „ , 
Taking the scaled limit on both sides shows ]T^ | 

1 / rph&vd ( Q . n \ 

E^ ld (s; a + 1) = - ( E^ d (s; (a - l)/2) + , * / ' \, r 
4 V ' ' 2 1 1 V ' V 7/7 £' lard (s;(a-l)/2) 



(3.19) 



(3.20) 



thus reducing the study of the (3 = 4 case down to that of the (3 — 1 and 2 cases. We will see that the 
analysis of E^ rd is also made easier by considering the Jacobi ensemble with 6 = 0. 

The simplified analysis of Ei &rd from this perspective comes about because the ensemble JOE|b = oU 
JOE|(,=o =: J 2 , formed out of two independent copies of the JOE with 6 = 0, has a simple determinant 
form for the Appoint distribution of the odd labelled coordinates (with the eigenvalues ordered < x\ < 

X 2 < ■ ■ ■ < X 2N < 1) PL 



(AModd/ 1 
P {k) (X 1 ,...,X k ) 



oi-^(o-l)/2 



det[K (xj,xi)] j ,y = i j ...,fc ) 



(3.21) 



K J \x, y) := - A(i - x f/* J\l - u)-^K J 



(x, u) du 



(3.22) 



where K J is the function (3.9) in the Jacobi case with 6 = and the a parameter left unchanged. 
To make use of (3.21) we follow 12 and first note 



(X J (s; a, 0, JV)) 2 = E j2 (s; a, 0, N) = E odd[j2) (s; a, 0, 2V), 



(3.23) 
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where the first equality follows from the definition of the ensemble J 2 , while the second equality follows 
from the fact that the eigenvalues have been labelled so that the first is closest to the edge at x = 0. 
Hence from (3.1) and (3.21) 

(£f(s;(a-l)/2,0,iV)) 2 = l + ^t^ f d Xl ---f dx k det[K J \ Xj , a:,)],-^!,...,*. (3.24) 

fe=i ' ^° ^° 

To proceed further we require the scaled limit of K J (x,y). 

Proposition 5. We have 

l im JL K J 2 (JLy) = .[y K f essel ( x ,y) + ^B-(l- f^J a (t)dt] =: K* essel (x,y) (3.25) 

where the convergence is uniform for x, y € (0, s). 

Proof. Using standard uniform estimates for the Jacobi polynomials, it has been shown in |l6[ that 
the left hand side of fl3~25| ) converges uniformly for x, y <E (0, s) to 



^(x 1/2 f ^ 1/2 ^ 2 Bcsscl (x,«) 



rfi> 



In the same reference, an identity equivalent to the equality between this expression and Kf essel has been 
given. □ 
It follows from Proposition || and ( |3.2l| ) that in addition to the pointwise convergence of the correla- 
tions, the stronger convergence property ( |3.4[ ) also holds. Furthermore, noting that i^p csscl is bounded 
for x,y <E [0, s] (by M say), and Hadamards lemma on bounds for determinants |3£| implies that 

p k (xi,...,x k ) <k k ' 2 M k (3.26) 

(note that the bound ( |3.12 ) no longer necessarily holds because Kf csscl is not symmetric). The inequality 
( [3.26 ), although a gross overestimate of the physically plausible p k < C k , is still sufficient to establish 
( |3.6| ), so we have that both criteria sufficient for the validity of ( |3.5| ) hold. Hence the scaled gap probability 
can be expanded in the following form, known but not rigorously justified in p2| . 

Proposition 6. We have 

[E^ d (s; (a - 1)/2)J = 1 + £ { — >- / dx, ■ ■ ■ dx k det^? 68861 ^, a:,)]i J i=i,...,fc (3.27) 

fe=i ' ^° ^° 

where Kf essel (x,y) is given by (3.21 ). 

Our final preliminary task is to present formulas analogous to ( 3.13| ), ( |3.20 ) and (3.27) for the scaled 
probabilities i*2(s), Fi(s) and F^s) occuring on the right hand side of (1.1), (1-5) and (1.7) respectively. 
By definition -Fi(s), F^s) and F^s) are the scaled probability of no eigenvalues at the edge of the 
spectrum of the Gaussian /3-ensemble, with f3 = 1, 2 and 4 respectively, the latter being specified by the 
eigenvalue probability density function 

i N 

in^' /2 n (3-28) 

Z=l l<j< k <N 



11 



Explicitly define 



E$( S ;f3,c;N) = - 



N 



dx N JJ< 



-cxf/2 



n \ x k-xj\ 

l<j<k<N 



Then 



Fi(s) := lim Ef{V2N + s/V2N 1/6 ; 1, 1; N) 



N 



F 2 (s) := lim E§ (V2N + s/V2N 1/6 - 2, 2; N) 



N 



F 4 (s) := lim Eg(V2N + s/V2N 1/6 - 4, 2; N/2). 



N 



(3.29) 



In general, choosing (c, AT) i-> (1, N), (2, AT), (2, AT/2) for = 1,2 and 4 in fl3.28|) and then scaling the 
coordinates by 



/2A^- 



37 



(3.30) 



gives the so called 'soft edge' process with parameter (3. The limiting fc-point correlation functions have 
been explicitly computed as a k x k determinant in the case (3 = 2 Jll|] , and a,kxk quaternion determinant 
(or equivalently Pfaffian) in the cases (3=1 and 4 p5| . Moreover, the uniform asymptotic expansion of 
the Hermite polynomials psf 

e~ x2 ' 2 H N {x) = ^- 3 / 4 2 w / 2+1 /4(An)-i/i2{^Ai(i) + 0(e^)0(iV- 2 / 3 )} (3.31) 

where x = (27V) 1 / 2 + t/2 1 / 2 N 1 / 6 , £ 6 [£o,oo), shows that the correlation functions converge not only 



pointwise, but also in the sense of (p.4|). In particular, in the case (3 = 2 this convergence, together with 
the bound ( [3. 12 ) implies the well known formula |35j 



F 2 ( S ) = 1 + Y / 

k=l 



(-1? 
k\ 



dx k det[K2™ y (xj , xi))jj =1: ... v k 



where 



^ 2 Airy (^,y) 



Ai(aOAi'(y) - M(y) Ai'(x) 



x-y 



(3.32) 



(3.33) 



In the cases (3 = 1 and (3 = 1 this line of reasoning gives an expansion for Fp(s) of the form ( 3.32 ), 
but involving a quaternion determinant in place of the scalar determinant in the case (3 = 2. However, 



derived [12 



analogous to (3.27), in the case (3 = 1 an alternative expansion involving a scalar determinant can be 

(^i(*)) 2 = i+E 



fe=i 



dx\ 



dx k det[K^" y (xj, x;)]:M=i,...,fc> 



K^ y (x 1 y)=Kt y (x,y)+M(x)( 



1 - 



Ai(v) dv 



(3.34) 



(3.35) 



The workings in fll2fl leading to ( 3.34 ) are formal rather than rigorous. Nonetheless, in the spirit of the 



chain of argument leading to (3.27), a rigorous derivation of (3.34) can be given 



We recall that in the rigorous derivation of (3.27) presented above, instead of working with the 
Laguerre ensemble, a particular Jacobi ensemble was analyzed. This was permitted because it could be 
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established that the limiting hard edge probability is the same in both the Laguerre and Jacobi ensemble. 



Likewise we undertake the task of a rigorous derivation of (3.34) by analyzing not the finite N GOE, but 
rather the finite N LOE with a = 0. The asymptotic analysis of jl6| shows that with the linear change 
of scale in this latter ensemble, 



xi ^47V + 2(2iV) 1/3 a;i, 



(3.36) 



the correlation functions converge to the limiting GOE soft edge correlations in the sense of ( p.4| ). Thus 
from Proposition || we can regard i*i(s) as the scaled limit of E^((s, oo); 0, N) where the latter denotes 
the probability that there are no eigenvalues in the interval (s, oo) of the finite N LOE with a = 0. The 
use of this perspective, analogous to the use of working with the 6 = Jacobi ensemble rather than the 
Laguerre ensemble at the hard edge, is that the ensemble LOE| a= oULOE| a= o = : L 2 , formed out of two 
independent copies of the LOE with a = 0, has a simple determinant form for the fc-point correlation of 
the even labelled coordinates (with eigenvalues ordered < x\ < X2 < ■ • ■ < X2N < oo) fl6|] , 



\k) 



011 (xi, . . . ,x k ) = det[K L (xj,xi)] jt i= 
K L \x,y) K L {x,u)du 



(3.37) 



where K is the function (J3.9|) in the Laguerre case with a = 0. To make use of (3.37), we note 



(X L (( S , co); 0, TV))' = E L \(s, oo); 0, N) = E e ™^((s, oo); 0, N) 



(3.38) 



(c.f. ( 3.23 )). Now we seek the scaled limit of K L and thus the scaled limit of p£ v 
Proposition 7. Let K 1 ny (x,y) be given by ftsldj ). We have 



lim 2(2iV) 1/3 if i2 (4A^ + 2(2iV) 1/3 a;,47V + 2(2iV) 1/3 ?/) = iry (x, y) 



(3.39) 



where the convergence is uniform on x,y £ (s, oo) with remainder terms which decay exponentially fast 
in x. 

Proof. This result is essentially contained in [fl6|| . Thus using the uniform asymptotic expansion 

e -«/2 a a/3 L . (s)=n «/2^_l^ Ai(t) + o(n -l/3 )0(e -t^ (3 . 40) 



where x = An + 2 + 2(2n) 1 / 3 i, t S [to, oo) (c.f. ( 3.31 )), in |T(| uniform convergence to 

K^ y {x,t) dt 



d_ '" ; 

dx 



(3.41) 



is established, as is the equality between ( 3.41 ) and K^" y . The uniform exponentially decaying bound 
on the error in ( |3.40D can be used to deduce that the remainder terms in the convergence of (3.3E) decay 
exponentially fast in x. The structure of the required working is the same as in the proof of Proposition 
H below, so the details will not be presented. □ 
The results of Proposition [7] allow ( [3.34 ) to be established. Thus, in light of the relation (3.38), and 
the evaluation of the scaled limit of we know from Proposition |^ that 

( [3.34 ) will be valid if the properties (3.5) and (3.6) can be verified. Now the structure of the convergence 
of K L in the scaled limit of ( [3.3S ) substituted in (3.37) shows immediately that the stronger convergence 
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(|3.5[) holds true. Furthermore, recalling that Ai(X) = 0(e 2:E 1 / 3 ) as a; — > oo we see that e x ii:f ir y (x,y) 
is bounded for x, y G [sq, oo) (by M say) and thus, making use also of Hadamards lemma we have 

Pk (x 1 ,...,x k )<e-^+- +Xk h k / 2 M k . 



This inequality establishes (3.6), thus concluding the working to justify (3.34). 

It remains to consider the soft edge gap probability for = 4. For this, we have the inter-relationship 
analogous to (3.19) p6j 



F 4 (s) 



(3.42) 



which was derived as the limiting form of an exact inter-relationship between the corresponding finite N 
gap probabilities in the Gaussian ensembles. 



4 The hard-to-soft edge transition 

It is our objective in this, the final section, to prove the following limit theorem. 



Theorem 1. For — 1,2 let E^ ard (s; a) denote the hard edge gap probability defined by ( 2.11 ) and (2.7), 
and let Fp(s) denote the soft edge gap probability defined by ( 3.2£\ ). We have 



lim £l lard (a 2 - 2a(a/2) 1/3 s + 0(a); call) = F (s), 
where c = 1 for = 1 and c — 2 for [3 = 2. 

Before discussing the proof of this theorem, let us first note an immediate corollary. 



(4.1) 



Corollary 2. Let E\ (s;a) denote the hard edge gap probability defined by (2.1i), and F±(s) denote 
the soft edge gap probability defined in ( 3. 2i ). We have that the limit relation ((.1) with c = 2 holds for 
= 4. 

Proof. We substitute s ^ a 2 — 2a(a/2) 1 / 3 s + O(a) in ( 3.19 ), and take the limit a — > oo on the right 
hand side by using (4.1). The resulting expression is precisely the right hand side of (3.42). □ 
Let us return now to Theorem [l| It turns out to be convenient to prove directly not (4.1), but rather 
the limit theorem 



lim E^ Td (Q a (sy,ca/2) = F (s), Q a (s) := (a- - s), (0 = 1,2) 



1/3 \2 



(4.2) 



Let us show that if we can prove ( L2 ) via Proposition [|, and thus prove that 



lim 



Qa(s) 



dx\ 



dxfc p^ ard (xi,...,x fc ) 



dxi 



dx kP f it (x u ...,x k ) (4.3) 



where 



pf rd (x!,...,x fe ) = det^—^x^xOJi^i, 



^"(x!,...^) - detlK^faxi)]^ 



(4.4) 
(4.5) 



(the criterium (3.6) has already been checked for p k oit so checking ( |4.3D is sufficient to deduce (^.2[)), and 
further show that 

k 

lim TT(-Qa(^))Pfe ard (Qa^i), • ■ ■ , Q a (x k )) = p s k oft (xu ■ ■ .,x k ), (4.6) 

a — *oo A J- 

1 = 1 



with convergence uniform on compact sets, then (4J) holds. 
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Lemma 1. Define Q a (s) as in (4J.), and suppose (4-t ) and ( \4-3j ) hold. Then 

rA a (s)+0(a) 



r-A a (s)+0(a) 

lim / dx\ ■ 

a ^°°Jo Jo 



dx k p\™ A {xi, . . . ,x k ) = I dx 



dx kPk oh {x 1 ,...,x k ) (4.7) 



where A a (s) = a 2 — 2a(a/2) 1 / 3 s, and consequently (4-1) holds. 



Proof. Now Q a (s) — A a (s) + 0(a 2 / 3 ), so the left hand side of (4/7) is unchanged if we replace A a (s) 
by Q a (s). Doing this, then noting 



rQ a {s)+0(a) rQ a {s)+0(a) 

lim / dx\ ■ ■ ■ 

a ^°° Jo Jo 

r2(a/2) 2/3 r2(a/2) 2/3 

dXf - I d Xk Hi-Q'aix^p^iQaix!), Q a (x k )) 



dx k pl™ d (x x ,...,x k ) 

k 



s+0(a-!/3) l=1 



it follows from (4.3) that (4.7) will hold provided 



lim / dx\ ■ 

G->°° J s+ Q(a-i/3) 



dx k Y[(-QM)pt al ' d (Qa^l), ■ • • , Qa(x k )) = 0. 
+0(o-V3) l=1 



But from ( [4.6| ) the integrand is bounded, so this holds true. With (4/7) established, ([O]) follows from 
Proposition ||. □ 
To establish ( [h6| ) and (4.3), we hrst prove the analogue of Proposition]^. 



Proposition 8. Let Q a {s) be given as in M-g). For = 1, 2, as a — > oo 

(Q' a (x)Q' a (y)) 1/2 K}r d {Qa{x),Qa{v)) = K^(x,y) + O (a' 1 / 3 ) 
where the remainder terms hold uniformly for x,y € (s,oo). 



-1/3^] 0(e- x ), 0=1 
O(e-y), f3 = 2, 



(4- 



Proof. Consider first the case (3 = 2. Recalling (3.11) and the definition of Q a from (4.2), we see 
asymptotic estimates of 

'.(«-©"). 4(«-(i)" 3 ») 

are required. Now results of Olver ]28| , Chapter 11 Sections 10.1-10.4] imply the uniform asymptotic 
expansion 



- ^r( T i ?)" 4 { Ai <" 2/3 o + o(^ /3 )o(«-""" £ )} 

valid for all z € C, arg z 7^ 7T, where £ = £(z) is specified by 

V =h8 1+ "- y -c-y 



(4.9) 



Thus for z — > + , £ diverges to +00, then monotonically decreases to at z = 1, where it has the power 
series expansion 



az) = 2 1 t\l-z) + 0{{l-zf). 



(4.10) 



We remark that the term 0(e u ' /3 ^) in (4.9) can be strengthened to involve the exponent (^ 2 / 3 £) 3 / 2 , but 
this refinement is not needed for our purpose. Let us set z = 1 — 2~ 1 / 3 u'/V 2 / 3 , where < w < 2 1 / 3 !/ 2 / 3 
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and thus < z < 1. Making use of (4.£), ( 4.1C ) and the fact that £(1 — z) is an increasing function for 
< z < 1, and using Taylor's theorem to estimate Ai(tu + e), |e| <C 1, shows 



Mv-wlu/S) 1 /*)* (J) 3 AiH+o(i)o(e^ ). 



To obtain the analogous expansion of we make use of the formula 

40) = \{Jv-i{z) - J v +i(z)). 



(4.11) 



(4.12) 



Setting v h-> v ± 1, then 2 = ^j(l - tu/2 1 / 3 ^ 2 / 3 ) in ( p~9[ ) shows 



J v±1 (v-w{v/2) x /*) 



© 1/3Ai ("-,V3, 
/ 2 \ 1/3 / 2 \ 2 /3 / 1 \ 

(-) AiH±(-J Ai'H+o(-JO(e- u ') 



where to obtain the second line the Airy function has been expanded to first order, and the error estimated 
using Taylor's theorem. Substituting this in ( 4.12Q shows that apart from the exponent in the term 
0(^ _1 ), (1.11) in fact remains valid upon formal differentiation with respect to w, and thus 

-(0 1/3 ^(---W2) 1/3 )-Q 1/3 Ai'H + O(,- 2 /3 )o(e -»). (4 . 13) 

Making use of ( 4.11 ) and ( 4.13 ) in fl3.ll ) with the substitution x >— > Q a {x), y h- > Q a (y), gives (|4.8| ) in 
the case (3 — 2, provided \x — y\ is bounded away from zero. This latter proviso is needed at this stage 
due to the term x — y in the denominator of the definition of i^2 ard : which could affect the decay of the 
error term. To see that in fact no such complication arises, for \x — y\ <C 1, we make use of i^2 ard being 
an analytic function in both x and y, and so permitting the Cauchy-type integral representation 

1 



K. 



hard 



{x,y) = 



2tt 



K^ Td (x,y + Re lt )dt 



(4.14) 



for arbitrary R > 0. Choosing R — 2a(a/2) 1 / 3 we see that to use this formula to analyze the left hand 
side of (4.8) we require the asymptotic estimates (4.11) and (4.13) with w = y — e lt + 0(z/~ 2 / 3 ). Note 
that the modulus of the error terms therein is 0(e~ v ). Substituting in ( 4.14 ) gives the Cauchy-type 
integral representation of i^| oft (a;, y) as the leading term while the remainder term is seen to be bounded 
by terms 0(a~ 1 ^ 3 )0(e~ x ~ v ) coming from the numerator in the definition of K2 ald (x, y + Re 1 *), times the 
maximum of the scaled denominator 

2a(q/2) 1 / 3 1 
\Q a (x) - Q a (y) + Re lt \ ~ \y - x + e*\ ' 

Because this is bounded for \x — y\ <C 1, we see that the error term in (4.14) is indeed as stated in (1.8) 
for /3 = 2. 

From the definition (3.25), to derive (4.8) in the case (3=1 the only remaining task is to give the 
asymptotic expansion of 

Qa{v) r2(a/2) 2/3 



J a {t)dt = - 



y a (t)J a (Q a (t))dt. 



But this follows immediately from (4.11), giving the form required by (1. 
With the asymptotic formulas (1.8) substituted in (4.4), we see that 



Hi-Q'^M^iQM . . . , Q a (x k )) = pf\x 1 , ...,x k )+0 (a- 1 / 3 ) 0(e 
i=i 



a 
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This shows immediately that (4.6) and (4.3) hold. Consequently the limit formula (4.2) is proved, and 



thus, via Lemma [0, so is (4.1). Now in the limit formula (1.7), extended to the case (3 = 4, c = 2 by 



Corollary g, substitute for i?^ ard according to the identities of Proposition |l|. The limit formulas (1.5) 



(1.4) and (1.7), equivalent upon de-Poissonization to limit theorems of Baik, Deift and Johansson 



and Baik and Rains |5|, are then reclaimed. 
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